Process for real-time data exchange

ABSTRACT

A process for real-time data exchange allows for sharing data, including metadata such as user data and phone data, between multiple handsets so that handsets may automatically display such data upon initiation or establishment of a telephone call, and in some arrangements throughout the life of the call. In this way, the need for subsequent data transmissions is reduced or eliminated, making bandwidth usage more efficient and conserving battery power.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.16/694,152, filed Nov. 25, 2019, which is a continuation of U.S. patentapplication Ser. No. 15/847,381, filed Dec. 19, 2017, entitled “PROCESSFOR REAL-TIME DATA EXCHANGE BETWEEN USERS ON A PHONE CALL”, now U.S.Pat. No. 10,491,745; which is a continuation of U.S. patent applicationSer. No. 14/623,057, filed Feb. 16, 2015, entitled “PROCESS FORREAL-TIME DATA EXCHANGE BETWEEN USERS ON A PHONE CALL”, now U.S. Pat.No. 9,866,684, which are incorporated herein by reference in theirentirety.

BACKGROUND

Typically the point of a phone call is for one person to exchangeinformation with another, and such occurs by the verbal (and sometimesvideo) communications between the individuals on the call. The phoneequipment itself may appear to provide information, but such informationgenerally is provided from the service provider, and the same is verylimited, e.g., limited to an identifying phone number for a caller andin some cases the caller's name, e.g., via caller identification.

This Background is provided to introduce a brief context for the Summaryand Detailed Description that follow. This Background is not intended tobe an aid in determining the scope of the claimed subject matter nor beviewed as limiting the claimed subject matter to arrangements that solveany or all of the disadvantages or problems presented above.

SUMMARY

Arrangements described utilize a local data-gathering service on atleast one client, e.g., running on a mobile device, which communicatesinformation associated with a first (caller) device, including about theuser, to a second (receiver) device when the first device initiates thecommunication with the second device. In this way, the second device maydisplay to its user data associated with the first device prior to thesecond device answering the call. Such may provide relevant data to theuser of the second device, assisting the user in determining how andwhether to answer the call. Data may also flow in the oppositedirection, allowing the first device to display data associated with thesecond device.

Relevant data may include those available from sensors and/orapplications running on a mobile device, e.g., accelerometer data, GPSdata, calendar data, battery life data, contacts information data,whether the calling user is employing a Bluetooth wireless headset orspeakerphone, or the like. This data is variously termed herein as“data” or “metadata”, and both are intended to include data thatdescribes or is associated with various aspects of a phone call.

For example, by communication of battery life data from one device toanother, a user may infer how long a caller is available to talk, or thesame may be automatically displayed by the service. Conversely, a usermay determine how long a receiver has available to talk. Multiplesources of data may be employed. For example, by use of GPS data andcalendar data, a mobile device of a receiver may display metadata thatthe caller is at a meeting location (from GPS data) and that a meetingis about to begin (from calendar data). Such data may be portrayed onthe receiver's mobile device, galvanizing the receiver to respondbecause the caller may be calling with an imminent question about theupcoming meeting. A step of analysis may be performed using receiveddata on any of the first or second devices, or cloud components, so asto automatically determine or guess aspects of the call as noted above.The analysis may also calculate an urgency index associated with thecall. In the above example, the receiver may infer from the context thatthe call is urgent, or the analysis may automatically determine or guesssuch urgency and indicate the same on the user interface on thereceiver's device.

Advantages of the invention may include, in certain embodiments, one ormore of the following. Significant bandwidth is saved by having datapre-gathered and forwarded to a device upon initiation of a call. In thesame way, battery life is significantly lengthened by performing suchsteps at times when devices are not actively engaged in a call. Periodsof time are minimized when mobile devices, which are generally severelyresource-constrained devices, are called upon to perform multiple taskssimultaneously. Data may be automatically displayed, conservingsignificant bandwidth while at the same time providing greaterinformation, data that was previously limited to at most a caller ID.Other advantages will be understood from the description that follows,including the figures and claims.

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. Elements or steps other than those described in thisSummary are possible, and no element or step is necessarily required.This Summary is not intended to identify key features or essentialfeatures of the claimed subject matter, nor is it intended for use as anaid in determining the scope of the claimed subject matter. Furthermore,the claimed subject matter is not limited to arrangements that solve anyor all disadvantages noted in any part of this disclosure. It may beappreciated that the above-described subject matter may be implementedas a computer-controlled apparatus, a computer process, using system, oras an article of manufacture such as one or more computer readablestorage media. These and various other features may be apparent fromreading of the following Detailed Description and a review of theassociated drawings

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows an illustrative environment in which users with deviceshaving communications capabilities interact over one or more networks,including a communications network accessed by respective accessnetworks.

FIG. 2 schematically illustrates various data sources employable in amethod for determining and sharing locally-collected data.

FIG. 3 illustrates various modular components employable in a system andmethod for determining and sharing locally-collected data.

FIG. 4 is a flowchart of a method employable by a phone data-gatheringapplication in a system and method for determining and sharinglocally-collected data.

FIG. 5 is a flowchart of a method employable by a cloud service in asystem and method for determining and sharing locally-collected data.

FIG. 6 is a flowchart of a method employable by a smart phone's nativephone application/operating system in combination with a service in asystem and method for determining and sharing locally-collected data.

FIG. 7 is a flowchart of a method employable by a phone data-gatheringapplication in a system and method for determining and sharinglocally-collected data, where the data is shared as part of aninteraction with a mobile operator network.

FIG. 8 illustrates one arrangement of a user interface in a system andmethod for determining and sharing locally-collected data.

FIG. 9 illustrates another arrangement of a user interface in a systemand method for determining and sharing locally-collected data.

FIG. 10 illustrates yet another arrangement of a user interface in asystem and method for determining and sharing locally-collected data.

FIGS. 11(A) and 11(B) illustrate a data flow and a user interface in afurther arrangement of a system and method for determining and sharinglocally-collected data.

FIGS. 12(A) and 12(B) illustrate a data flow and a user interface in afurther arrangement of a system and method for determining and sharinglocally-collected data.

FIG. 13 shows a block diagram of an illustrative system that may be usedin part to implement the present systems and methods for determining,storing, and sharing locally-collected data.

FIG. 14 is a block diagram of an illustrative mobile device.

Like reference numerals refer to like elements throughout. Elements arenot to scale unless otherwise noted. It is emphasized that theparticular user interfaces displayed in the drawings can vary from whatis shown according to the needs of a particular arrangement. While userinterfaces are shown in portrait mode in the drawings, the presentarrangement may also be implemented using a landscape mode.

DETAILED DESCRIPTION

FIG. 1 shows an illustrative communications environment 100 in whichvarious users 105 employ respective devices 110 that can interact overone or more communications networks which can typically include variousaccess networks (representatively indicated by reference numerals 112 a,112 b, and so on) and a communications network 114. The communicationsnetwork 114 typically uses IP-based transport and signaling and can besupported, for example, by mobile operators, enterprises, Internetservice providers (ISPs), telephone service providers, data serviceproviders, and the like.

The communications network 114 typically includes interfaces thatsupport a connection to the Internet so that the devices 110 can accesscontent and communicate with each other through a network interface. Thedevices 110 and communications network 114 may be configured to enabledevice-to-device communication using peer-to-peer and/or server-basedprotocols. Support for device-to-device communications may be provided,at least in part, using various applications that run on devices 110.

The devices 110 may provide various capabilities, such as voice andvideo calling and messaging, and typically support data-consumingapplications such as Internet browsing and multimedia (e.g., music,video, etc.) consumption in addition to various other features. Thedevices 110 may include, for example, user equipment, mobile phones,cell phones, feature phones, tablet computers, and smartphones whichusers often employ to make and receive voice and/or multimedia (i.e.,video) calls, engage in messaging (e.g., texting), use applications andaccess services that employ data, browse the World Wide Web, and thelike.

Alternative types of electronic devices are also envisioned to be usablewithin the communications environment 100 so long as they are configuredwith communication capabilities and can connect to the IP communicationsnetwork 114. Such alternative devices variously include handheldcomputing devices, PDAs (personal digital assistants), portable mediaplayers, phablet devices (i.e., combination smartphone/tablet devices),wearable computers, wearable devices in communication with mobile orcellular or other devices described here, navigation devices such as GPS(Global Positioning System) systems, laptop PCs (personal computers),desktop computers, multimedia consoles, gaming systems, networked and/orremotely controlled cameras, or the like. Such cameras may include, forexample, room and home surveillance cameras, body-worn cameras, webcams,external cameras used with PCs, tablets, and other computing devices,remote cameras in vehicles, etc. In the discussion that follows, the useof the term “device” is intended to cover all devices that areconfigured with communication capabilities and have IP accesscapabilities to the IP communications network 114.

The various devices 110 in the environment 100 can support differentfeatures, functionalities, and capabilities (here referred to generallyas “features”). Some of the features supported on a given device can besimilar to those supported on others, while other features may be uniqueto a given device. The degree of overlap and/or distinctiveness amongfeatures supported on the various devices 110 can vary by arrangement.For example, some devices 110 can support touch controls, gesturerecognition, natural language interfaces, and voice commands, whileothers may enable a more limited user interface. Some devices maysupport video consumption and Internet browsing, while other devices maysupport more limited media handling and network interface features.

Accessory devices (not shown), such as wristbands and other wearabledevices, may also be present in the environment 100. Such accessorydevices typically are adapted to interoperate with a device 110 usingcommunication protocols like Bluetooth® and USB (Universal Serial Bus)to support functions such as monitoring of the wearer's physiology(e.g., heart rate, steps taken, calories burned, etc.) and environmentalconditions (temperature, humidity, ultra-violet (UV) levels, etc.), anddisplaying notifications from the coupled device 110.

Many arrangements according to present principles cause data to appearon a second device 110 _(N), the data relevant to a communicationbetween a first device 110 ₁ and the second device 110 _(N). In otherwords, data about first device 110 ₁, including about its user, appearson the second device 110 _(N), particularly during initiation of acommunication from the first device to the second device, allowing theuser of the second device to obtain information about the status of thefirst device and its user, this information potentially useful to theuser of the second device in answering the call from the first device.

FIG. 1 illustrates various ways in which this information can becommunicated. In one exemplary way, a service may be implemented forservice communications 113 which are supported by either the nativeoperating system of the device or through an application. In onearrangement, the service has a client service interface 115 ₁ running onthe first device 110 ₁ and a client service interface 115 _(N) runningon the second device 110 _(N), as well as a remote or cloud servicecomponent 117 operating on a cloud server 123. The client serviceinterface 115 ₁ works with a local data-gathering client (describedbelow) to transmit harvested data from one or more data sourcesavailable to the local mobile device. The harvesting may be performed inreal time during initiation or pendency of a call, including harvestingresponsively to one or more relevancy criteria. The remote or cloudservice interface or component 117 may be employed to communicateharvested data to a remote service over a network interface and forreceiving data from the remote service, the communicating beingperformed according to the variability of the harvested data, so as toallow a remote device to display aspects of these variable features. Notall communicated data need be displayed in some arrangements; rather,the remote service may apply filtering criteria to determine whichharvested data is transmitted to the remote device for display, suchthat only data that meets one or more criteria passes through the filterfor display. The second device may also employ a local data renderingclient 116 _(N) to determine which data received from the remote serviceis rendered as selected metadata on the user interface. In determiningwhich data is displayed on the second device, the determination may beperformed by the first device 115 ₁, the service interface 117, or thelocal data rendering client 116 _(N) or a combination of these. Forexample, the first device 115 ₁ may be configured to only send data thatwill be transmitted and displayed. Alternatively, the first device maysend all data collected, and service interface 117 may be employed todetermine what data will be transmitted and displayed. As anotheralternative, the first device may send all data, the service interface117 may also send all data it receives from the first device to thesecond device, and the local data rendering client 116 _(N) may selectwhat data is displayed. As noted combinations of these differentfunctionalities may also be employed and will be understood. Inimplementing the arrangement by a service, the service may employ a RESTAPI to push the data to some cloud storage location, which may be thecloud server 123.

A service may be particularly appropriate for certain arrangements as inmany cases only a few bytes of data are required to identify relevantmetadata, e.g., context data for the first device, and the same may bestored securely by the server in the cloud using a hash associated withthe user whose device and context data is being stored. For example, thelocation data may be communicated in less than 14 bytes, and calendardata is similar, although additional bytes may be employed for stringdata identifying a particular appointment or meeting. Subject data,described below, may be conveyed in as many bytes as are required tostore the subject string. If the first device is using a Bluetoothwireless headset or speakerphone, such status may be conveyed in lessthan one byte, in some cases one or two bits. Battery life may beconveyed in about one byte. The service may be conveniently employed totransmit, store, and provide such metadata.

While a common arrangement describe here involves a service transmittingdata about a first device to a second device, it will be understood thatdata flow in the reverse direction may also be employed, i.e., where thesecond (receiver) device is the source of data provided to the first(caller) device. For example, such may indicate to a caller the batterylife of the receiver's device, and thus an expected maximum duration ofa phone call. Such may also indicate an upcoming appointment of thereceiver, and thus the caller knows to keep the call short.

FIG. 1 also shows alternative ways of communicating metadata betweendevices. For example, a voice channel 119 may be employed to communicaterelevant identified metadata. That is, while the voice channel 119 isemployed for voice communications, the same may be modulated to embedmetadata information within, or metadata communications may be by userof a frequency that is inaccessible to human hearing. Alternatively, aseparate data channel 121 may be employed for such communications.Additionally in some cases, a given device may be able to establishconnectivity with more than one access network. For example, asmartphone may have capabilities to use either Wi-Fi or cellular data insome situations, and thus Wi-Fi communications may be employed tocommunicate metadata according to the methods described, at least to thecommunications network 114.

FIG. 2 illustrates in a modular fashion a device 110 running adata-gathering application 120. The data-gathering application 120collects data from various sources associated with the user's phone,e.g., from a caller's phone or a “first device”. The data-gatheringapplication 120 may collect and store such data, collectively termedmetadata, and may further transmit or cause the transmission of themetadata to a receiver's device, e.g., a “second device”. The way inwhich the data-gathering application 120 provides the metadata to thesecond device may vary, and may include use of a service, use ofchannels associated with a mobile carrier or operator, and so on.

Generally the data-gathering application 120 harvests or collects datafrom numerous sources, as will be described, and a step is performed ofanalyzing the collected data to determine data relevant to thecommunication, this data displayed on the receiver's mobile device priorto or during the pendency of the communication. The analyzing thecollected data may include comparing the collected data to one or morecriteria, which may be predetermined or which may be dependent on otherdata, and if the collected data meet the requirements of the criteria,the same may be chosen to be transmitted to a remote device from a localdevice for display. Alternatively, if all collected data is transmittedto the service, or more than that which is chosen for display, and asubset is selected for transmission and display, then the collected datathat meet the criteria may be that which is selected.

Generally the date is displayed prior to the communication, and caninform the receiver of how and whether to take the call. The analysisstep may be performed by the service, by an application hosted on acloud server, by the data-gathering application 120 on the caller orreceiver mobile device, or on a combination of these. Where a mobileoperator performs a step within the arrangement, such as by having localdata collected from data-gathering applications hosted on a mobileoperator server, then such a server may also host an analysisapplication. Other variations will also be understood.

Exemplary data sources are now described. A first data source may be anaccelerometer 118 a. Most mobile devices include such as part ofstandard circuitry, and the same may be employed to determine if theuser of the device is moving, stationary, how long the user has beenstationary, whether the user has been exercising, and so on. Theaccelerometer 118 a may thus provide useful data which may be in theways described transmitted for display on the receiver mobile device.

A second data source may be GPS circuitry 118 b. Such GPS circuitry isalso generally standard on most modern smart phones, and the same canprovide location data where the user has opted for enablement of the GPSfunctionality. Location data may be employed as metadata to allow areceiver mobile device to display whether a caller mobile device is inproximity to the receiver, at particular locations such as hospitals,home, or work, or to provide other location-based functionality as willbe understood. Of course, a caller generally must enable suchlocation-determination functionality, for privacy reasons.

A third data source may be a database or other data collection tool 118c for a calendar or tasks application. This data source may be employedand may be used to inform the receiver device of upcoming meetings orappointments. For example, as noted above, if calendar data indicatethat a caller has an upcoming imminent meeting, a communication fromsuch a caller may be the cause of an indication on the receiver mobiledevice that the caller may be calling about an upcoming imminentmeeting. In the same way, if a task is associated with a location or atime for performance, and if a call occurs when the caller is at thelocation or during the time for performance, a communication from such acaller may be the cause of an indication on the receiver mobile devicethat the caller may be calling about the task.

A fourth source of data may include certain settings data 118 d, such aswhether the caller is using Bluetooth or speakerphone, as opposed to atypical internal handset speaker. In this way, the receiver may beinformed as to whether others may be privy to the communication, oralternatively whether communications may be considered private.

A fifth source of data may be battery life data 118 e. In this way, thereceiver may be informed as to whether the caller has just a short timeto talk. This type of data, as well as other types of data, may also betransmitted in the opposite direction to the caller's mobile deviceabout the receiver's mobile device and data thereon. For example, acaller may use such data to determine if a receiver has time to talkbefore their battery dies. The battery life data 118 e may also beadvantageously employed in urgency determinations. For example, the samemay be used in combination with contact information data to determineurgency of a call.

Besides GPS data, a sixth data source may include other data forgeolocation 118 f, including data about nearby Wi-Fi access points, ifsuch can be detected and/or if a mobile device is close enough to one ormore known Wi-Fi access points to determine location. In this context itis also noted that Wi-Fi may also be employed for communication of themeta-data, as well as just for geolocation.

A seventh source of data may include phone application data 118 g, i.e.,data from browsers or other applications. For example, if the caller hasbeen browsing a restaurant review immediately before the call, the datadisplayed on the second device may include an indication of such.Privacy concerns may require a level of “opting in” to such disclosureof data, for this and for any other type of data transmitted for displayon a second or receiver mobile device.

An eighth source of data may include data 118 h from an exerciseapplication. In this way, the receiver may have data displayed aboutwhether the caller has been or is currently exercising. In some cases,similar data may be received from the first data source, i.e., anaccelerometer 118 a.

A ninth data source may include user input 118 i, including usingvoice-driven user interfaces. For example, a calling user may employMicrosoft's Cortana® intelligent personal assistant to enter subjectdata, as well as to initiate the call. For example, the user may say“Cortana please call David about dinner tonight” and the data-gatheringapplication may not only retrieve and transmit the subject of “DinnerTonight” but may also initiate the call to David. Similarly, a tenthdata source 118 j may be employed to enter subject information viakeyboard, touchpad, voice recognition, or other user interface inputs.

Finally, an eleventh data source 118 k may correspond to wearabledevices that are in data communication with a caller or receiver'smobile device, e.g., heart rate monitors, temperature monitors, bloodpressure monitors, and so on. Such may be employed to communicate datato receiver mobile devices, e.g., in medical or counseling applications.

While a number of data sources have been described above, it will beunderstood given this teaching that other data sources may also beemployed. Moreover, while transmission of various data types has beendescribed, the arrangements may further include transmitting dataincluding files from one device to another, including files enclosingmeeting invitations, tasks, and the like.

Referring next to FIG. 3, a modular depiction of an exemplary first orsecond device 110 is displayed, which may be embodied by a mobilehandset, tablet, or other device as described above. In relevant part,the device 110 generally includes a phone data-gathering application 120and a smart phone native application or operating system component 122.The phone data-gathering application 120 is generally responsible forgathering data from sources described elsewhere and storing the same,either within the application or within an accessible memory, such as ina local data store. The native phone application or operating systemcomponent 122 may be employed in some cases as an interface between thedata-gathering application and data sources, and may further be employedto display identified metadata, relevant to the communication, on a userinterface of the device 110.

In one arrangement a client service interface 115 interacts with a cloudservice component 124, such as may be situated on a cloud server 124′.The client service component 115 sends the requisite bytes of dataharvested by the data-gathering application 120 using the client servicecomponent 115 to the service 124. In another arrangement, thedata-gathering application 120 may send data to a cloud server forsubsequent transmission to another device using a cloud server withoutusing a service. In this latter case, data may be transmitted using anynumber of transmission schemes and protocols, including, e.g., textmessaging and the like. A local data rendering client 116 is also shownin FIG. 3, and the same is as described above in connection with FIG. 1.

Other components relevant to the operation of the device 110 aredescribed below in connection with FIGS. 13 and 14.

FIG. 4 illustrates a flowchart 130 of a method which may be performed bya data-gathering application, such as may run within the mobile device110, and in particular within a first device or “calling” device. Thedata-gathering application generally constitutes a primary component inthe data-gathering process. The data-gathering application is generallya long-running background task which can passively gather data (step126) from data sources within (or in communication with) the mobiledevice such as, but not limited to, GPS coordinates, compass directions,battery life, calendar data, data from wearable devices, and the like.

The data-gathering application may be configured to accept anotification event when a phone call has been initiated (step 127). Uponacceptance of the notification event, the data-gathering application cangather “on the spot” or “real-time” data, including speakerphone status,current battery life, next calendar appointment, and so on (step 128).

The data-gathering application may then connect to a cloud service inorder to upload data to a secured and central location (step 129). Insome arrangements, the data-gathering application may have previouslyconnected to the cloud service to upload data to the secured and centrallocation, even without the initiation of a phone call.

As part of its reception of the initiated phone call, a correspondingdata-gathering application on the second device, e.g., a receiverdevice, may gather data from the cloud service for storage and/ordisplay (step 132). That is, data may be gathered about the otherconnected users information, the data gathered from the cloud service,the data stored in a local device store for subsequent consumption anddisplay.

Having provided the second device identified metadata relevant to thecommunication, the phone call is answered in a subsequent step (step134), and the data-gathering application (of both the first and seconddevice) may continue to gather data and uploads the same to the service(step 135).

In some cases a cloud application or application running on a servicemay be employed to analyze received data from respective data-gatheringapplications in order to determine if a call made by a calling deviceshould be marked as urgent (step 133). Equivalently, analysis may beperformed to determine what data, of the collected data, should bedisplayed on the receiver device. In the same way either the same or adifferent cloud application may be employed to determine the “freshness”of data. In particular, while some data may not change rapidly overtime, other data may, such as whether the user is on speakerphone ornot. For such data, and to conserve battery life, it may be desired toreduce data transmissions corresponding to less-frequently-varying data.In other words, the bytes of data transmitted through the service mayvary depending on the type of data, and the service (or cloudapplication) may determine the freshness of the data, only identifyingthe same as relevant to the communication if the freshness meets orexceeds a predetermined threshold for that type of data (the criteriafor freshness may vary for different types of data, e.g., battery lifedata will generally vary less rapidly than data about speakerphonestatus). Alternatively, even less-fresh data may be provided fordisplay, with an appropriate indication of a confidence interval. Forexample, the same may be displayed as a range.

Analysis of such data may also include use of default data types, suchthat default data types are provided if no other analysis is available,e.g, as a default data types of battery life and next upcoming meetingmay be transmitted for display to a receiver device. Users may beenabled in some arrangements to set such default data types.

FIG. 5 is a flowchart 140 corresponding to steps performed by a servicewithin an exemplary arrangement. The service is generally a componentwhich facilitates the central and secure sharing of data between twoconnected users. It will be understood that similar steps may beperformed by a server application in signal communication with a callingand receiving device.

Steps performed by the service include initial steps of configuring theservice to interoperate with local clients on devices (step 141), e.g.including downloading client service components or other applications onthe devices if necessary. In one arrangement, the service may beconfigured by exposing a REST API to client devices.

The service may then accept one or more connections from respectivedata-gathering applications (step 142). The service may store data sentby the respective data-gathering applications (step 143). The data isstored for later retrieval and provision to other client devices asrequested.

In some cases a subject string, e.g., “let's talk about the upcomingmeeting”, may be entered by a caller, e.g., by voice or by another userinput method, and received by the service (step 144). The service maythen use the subject string as part of the data provided for display toa second device, i.e., a receiver device.

Upon initiation of the communication (step 145), the service may receivea content retrieval request from the receiver device, for identifiedmetadata relevant to the communication (step 146). The request may bevalidated and a determination made as whether the receiver device isentitled to receive data from the calling device. Assuming appropriatevalidation occurs, metadata may be identified as relevant to thecommunication (step 147). To identify data as relevant, other datasurrounding a nexus of facts may be determined and analyzed. Forexample, a phone call from a colleague may have a certain relevance, butif calendar data indicates the colleague is about to enter an importantmeeting, and if location data indicates the colleague is at the meetinglocation, such data may be employed as part of an indication displayedon a receiver device, as the timing and location indicate data about themeeting. As discussed above, the step of identifying metadata that hasrelevance may also include a step of analyzing data for freshness.

Data from one device may then be sent to the other device (step 148),including data such as a subject string if one was provided and/ordetermined. Each device may continue to receive data through itsrespective data gathering application, and this data may be provided tothe other device if determined to be relevant to the communication. Forexample, if the receiver is having a dinner party and an incoming phonecall is from a dinner party participant who is late for the dinnerparty, and GPS data indicates the late participant is driving around theneighborhood, the display may indicate the likelihood that the lateparticipant needs directions to the dinner party. When the call isanswered and the host is providing directions to the dinner party,transmitted and displayed metadata may be updated to indicate to thereceiving device the current location of the caller.

FIG. 6 is a flowchart 150 which may be performed by a native phoneapplication in concert with the described arrangement, or in some casesby the native smart phone operating system (in the case where the samecontrols phone activity). The native phone application constitutes themain component in triggering and displaying the results of the mutualdata-gathering.

In a first step, the native phone application or operating system sendsa trigger event to the data-gathering application that a phone call hasbeen instantiated. Metadata may be retrieved from the phone serviceprovider (step 154), such metadata including caller ID information andthe like. More substantively, the native phone application may monitor alocal device store written to by the data-gathering application (step156). That is, the data-gathering application may receive relevant datathrough the service from the other device, and this data may be writteninto a local device store. This data may then be formatted and displayedonce retrieved from the local device store (step 158).

FIG. 7 is a flowchart 125 which is in some way similar to the flowchart130 of FIG. 4. Certain steps are common to each, and the same are notrepeated in this description. In this arrangement, however, when thedata-gathering application of the caller uploads gathered data, the sameoccurs using a communication mechanism of a mobile operator (step 175).For example, data may be uploaded using modulation of a voice channel,using a separate data channel, using a frequency not audible to thehuman ear, or the like. The receiver's device likewise uses acommunications mechanism of the mobile operator to gather the identifiedmetadata about the caller's device, for storage and display at thereceiver's device (and vice-versa).

An application running on a cloud server, e.g., which may be hosted bythe mobile operator, may be employed to analyze the received data tomake inferences and/or to determine urgency (step 181) in a similarfashion as described above with respect to step 133 of FIG. 4. And as inFIG. 4, data-gathering may continue to operate, with data sources beingmonitored and data transmitted to a cloud server (step 185).

FIG. 8 illustrates exemplary data which may be displayed on a userinterface of a device 110. In this user interface, a map 162 isportrayed, with both the receiver “YOU” and the caller displayed aspoints on the map. Data employed to generate the map 162 are usuallyfrom GPS data, although other sources may be employed in othercircumstances.

Options are provided for the receiver to respond to the call, includinga button 164 to answer the call and a button 166 which may be employedtext a reply. Various other metadata are displayed in combination withthe displayed map, including a proximity indicator 168 indicating thedistance and direction of the caller relative to the receiver, as wellas the current location of the caller. A call history indicator 172 isshown, indicating an average length of call over the last four calls. Itwill be understood that the above indicators are merely exemplary andany number of other indicators may also be provided.

The map 162 has various icons overlaid providing additional informationabout the caller. An icon 161 indicates that the call is an incomingconference call, with three participants already on the call. The icon163 indicates that the caller's phone is low on battery power. The icon165 indicates that the caller is using a speakerphone, and the icon 167indicates that the caller desires that the call be a video call. Othericons may also be employed according to circumstance.

FIG. 9 shows another user interface, and in particular a differentfeature on the user interface, in this case subject information enteredby the caller. For example, the caller may have used a voice-driven userinterface to request that the phone call be made for the purpose ofasking for information about an upcoming meeting. The user interfaceelement 174 thus indicates the subject and the results of the voicecommand.

FIG. 10 illustrates another user interface, and in particular a userinterface element 178, in this case providing the name, phone number,and an image of the caller. In this user interface an additional optionis shown, namely, an option 176 to ignore the call.

FIG. 11 depicts an example of multiple data inputs and an analysis step.In particular, FIG. 11(A) illustrates data inputs leading to thedevelopment and generation of a user interface feature 188, and FIG.11(B) illustrates implementation of the feature 188 on the userinterface of the device 110. In particular, the data-gatheringapplication 120 may receive data from a calendar application 182 anddata 184 from GPS circuitry. A step of analysis may be performed withdata gathered by the application 120. In this case the analysisindicates that a dinner party is imminent, and that a participant,“John”, is in the vicinity but not at the location. The analysis maycause a guess that “John” is calling because he needs to ask fordirections.

FIG. 12 depicts another example. FIG. 12(A) illustrates data inputsleading to the development and generation of a user interface feature198, and FIG. 12(B) illustrates the feature 198 on the user interface ofthe device 110. In particular, the data-gathering application 120 mayreceive data from a contacts application 192 and data about battery life194. A step of analysis may be performed with the data gathered by theapplication 120. In this case the analysis indicates that the caller isthe spouse of the receiver, and that her cell phone battery has lowbattery life. In this case, such an indication may indicate that it isparticularly important for the receiver to answer the call.

Numerous other examples will also be understood, given this teaching.

FIG. 13 shows an illustrative architecture 2600 for a device capable ofexecuting the various components described herein for providing thepresent data determination, sharing, and display notifications. Thus,the architecture 2600 illustrated in FIG. 13 shows an architecture thatmay be adapted for a server computer, mobile phone, a PDA, a smartphone,a desktop computer, a netbook computer, a tablet computer, GPS device,gaming console, and/or a laptop computer. The architecture 2600 may beutilized to execute any aspect of the components presented herein.

The architecture 2600 illustrated in FIG. 13 includes a CPU (CentralProcessing Unit) 2602, a system memory 2604, including a RAM 2606 and aROM 2608, and a system bus 2610 that couples the memory 2604 to the CPU2602. A basic input/output system containing the basic routines thathelp to transfer information between elements within the architecture2600, such as during startup, is stored in the ROM 2608. Thearchitecture 2600 further includes a mass storage device 2612 forstoring software code or other computer-executed code that is utilizedto implement applications, the file system, and the operating system.

The mass storage device 2612 is connected to the CPU 2602 through a massstorage controller (not shown) connected to the bus 2610. The massstorage device 2612 and its associated computer-readable storage mediaprovide non-volatile storage for the architecture 2600.

Although the description of computer-readable storage media containedherein refers to a mass storage device, such as a hard disk or CD-ROMdrive, it may be appreciated by those skilled in the art thatcomputer-readable storage media can be any available storage media thatcan be accessed by the architecture 2600.

By way of example, and not limitation, computer-readable storage mediamay include volatile and non-volatile, removable and non-removable mediaimplemented in any method or technology for storage of information suchas computer-readable instructions, data structures, program modules, orother data. For example, computer-readable media includes, but is notlimited to, RAM, ROM, EPROM (erasable programmable read only memory),EEPROM (electrically erasable programmable read only memory), Flashmemory or other solid state memory technology, CD-ROM, DVDs, HD-DVD(High Definition DVD), Blu-ray, or other optical storage, magneticcassettes, magnetic tape, magnetic disk storage or other magneticstorage devices, or any other medium which can be used to store thedesired information and which can be accessed by the architecture 2600.

According to various embodiments, the architecture 2600 may operate in anetworked environment using logical connections to remote devices andcomputers through a network. The architecture 2600 may connect to thenetwork through a network interface unit 2616 connected to the bus 2610.It may be appreciated that the network interface unit 2616 also may beutilized to connect to other types of networks and remote computersystems. The architecture 2600 also may include an input/outputcontroller 2618 for receiving and processing input from a number ofother devices, including a keyboard, mouse, or electronic stylus (notshown in FIG. 13). Similarly, the input/output controller 2618 mayprovide output to a display screen, a printer, or other type of outputdevice (also not shown in FIG. 13).

It may be appreciated that the software components described herein may,when loaded into the CPU 2602 and executed, transform the CPU 2602 andthe overall architecture 2600 from a general-purpose computing systeminto a special-purpose computing system customized to facilitate thefunctionality presented herein. The CPU 2602 may be constructed from anynumber of transistors or other discrete circuit elements, which mayindividually or collectively assume any number of states. Morespecifically, the CPU 2602 may operate as a finite-state machine, inresponse to executable instructions contained within the softwaremodules disclosed herein. These computer-executable instructions maytransform the CPU 2602 by specifying how the CPU 2602 transitionsbetween states, thereby transforming the transistors or other discretehardware elements constituting the CPU 2602.

Encoding the software modules presented herein also may transform thephysical structure of the computer-readable storage media presentedherein. The specific transformation of physical structure may depend onvarious factors, in different arrangements of this description. Examplesof such factors may include, but are not limited to, the technology usedto implement the computer-readable storage media, whether thecomputer-readable storage media is characterized as primary or secondarystorage, and the like. For example, if the computer-readable storagemedia is implemented as semiconductor-based memory, the softwaredisclosed herein may be encoded on the computer-readable storage mediaby transforming the physical state of the semiconductor memory. Forexample, the software may transform the state of transistors,capacitors, or other discrete circuit elements constituting thesemiconductor memory. The software also may transform the physical stateof such components in order to store data thereupon.

As another example, the computer-readable storage media disclosed hereinmay be implemented using magnetic or optical technology. In sucharrangements, the software presented herein may transform the physicalstate of magnetic or optical media, when the software is encodedtherein. These transformations may include altering the magneticcharacteristics of particular locations within given magnetic media.These transformations also may include altering the physical features orcharacteristics of particular locations within given optical media tochange the optical characteristics of those locations. Othertransformations of physical media are possible without departing fromthe scope and spirit of the present description, with the foregoingexamples provided only to facilitate this discussion.

In light of the above, it may be appreciated that many types of physicaltransformations take place in the architecture 2600 in order to storeand execute the software components presented herein. It may also beappreciated that the architecture 2600 may include other types ofcomputing devices, including handheld computers, embedded computersystems, smartphones, PDAs, and other types of computing devices knownto those skilled in the art. It is also contemplated that thearchitecture 2600 may not include all of the components shown in FIG.13, may include other components that are not explicitly shown in FIG.13, or may utilize an architecture completely different from that shownin FIG. 13.

FIG. 14 is a functional block diagram of an illustrative mobile device110 such as a mobile phone or smartphone including a variety of optionalhardware and software components, shown generally at 2702. Any component2702 in the mobile device can communicate with any other component,although, for ease of illustration, not all connections are shown. Themobile device can be any of a variety of computing devices (e.g., cellphone, smartphone, handheld computer, PDA, etc.) and can allow wirelesstwo-way communications with one or more mobile communication networks2704, such as a cellular or satellite network.

The illustrated device 110 can include a controller or processor 2710(e.g., signal processor, microprocessor, microcontroller, ASIC(Application Specific Integrated Circuit), or other control andprocessing logic circuitry) for performing such tasks as signal coding,data processing, input/output processing, power control, and/or otherfunctions. An operating system 2712 can control the allocation and usageof the components 2702, including power states, above-lock states, andbelow-lock states, and provides support for one or more applicationprograms 2714. The application programs can include common mobilecomputing applications (e.g., image-capture applications, emailapplications, calendars, contact managers, web browsers, messagingapplications), or any other computing application.

The illustrated mobile device 110 can include memory 2720. Memory 2720can include non-removable memory 2722 and/or removable memory 2724. Thenon-removable memory 2722 can include RAM, ROM, Flash memory, a harddisk, or other well-known memory storage technologies. The removablememory 2724 can include Flash memory or a Subscriber Identity Module(SIM) card, which is well known in GSM (Global System for Mobilecommunications) systems, or other well-known memory storagetechnologies, such as “smart cards.” The memory 2720 can be used forstoring data and/or code for running the operating system 2712 and theapplication programs 2714. Example data can include web pages, text,images, sound files, video data, or other data sets to be sent to and/orreceived from one or more network servers or other devices via one ormore wired or wireless networks.

The memory 2720 may also be arranged as, or include, one or morecomputer-readable storage media implemented in any method or technologyfor storage of information such as computer-readable instructions, datastructures, program modules or other data. For example,computer-readable media includes, but is not limited to, RAM, ROM,EPROM, EEPROM, Flash memory or other solid state memory technology,CD-ROM (compact-disc ROM), DVD, (Digital Versatile Disc) HD-DVD (HighDefinition DVD), Blu-ray, or other optical storage, magnetic cassettes,magnetic tape, magnetic disk storage or other magnetic storage devices,or any other medium which can be used to store the desired informationand which can be accessed by the mobile device 110.

The memory 2720 can be used to store a subscriber identifier, such as anInternational Mobile Subscriber Identity (IMSI), and an equipmentidentifier, such as an International Mobile Equipment Identifier (IMEI).Such identifiers can be transmitted to a network server to identifyusers and equipment. The mobile device 110 can support one or more inputdevices 2730, including a touch screen 2732; a microphone 2734 forimplementation of voice input for voice recognition, voice commands andthe like; a camera 2736; a physical keyboard 2738; a trackball 2740;and/or a proximity sensor 2742; and one or more output devices 2750,such as a speaker 2752 and one or more displays 2754. Other inputdevices (not shown) using gesture recognition may also be utilized insome cases. Other possible output devices (not shown) can includepiezoelectric or haptic output devices. Some devices can serve more thanone input/output function. For example, touchscreen 2732 and display2754 can be combined into a single input/output device.

A wireless modem 2760 can be coupled to an antenna (not shown) and cansupport two-way communications between the processor 2710 and externaldevices, as is well understood in the art. The modem 2760 is showngenerically and can include a cellular modem for communicating with themobile communication network 2704 and/or other radio-based modems (e.g.,Bluetooth 2764 or Wi-Fi 2762). The wireless modem 2760 is typicallyconfigured for communication with one or more cellular networks, such asa GSM network for data and voice communications within a single cellularnetwork, between cellular networks, or between the mobile device and apublic switched telephone network (PSTN).

The mobile device can further include at least one input/output port2780, a power supply 2782, a satellite navigation system receiver 2784,such as a GPS receiver, an accelerometer 2786, a gyroscope (not shown),and/or a physical connector 2790, which can be a USB port, IEEE 1394(FireWire) port, and/or an RS-232 port. The illustrated components 2702are not required or all-inclusive, as any components can be deleted andother components can be added.

In some cases, the components described can serve as a source oflocally-collected data, and such is particularly true of the port 2780,the receiver 2074, the accelerometer 2786, and physical connector 2790,as well as transceivers for Bluetooth communications and networkcommunications, as the same may be conveniently employed to determineuser metadata which can then be gathered by the data-gatheringapplication and uploaded to a cloud service for subsequent transmissionto one or more other devices, e.g., for display.

Variations of the above will be understood. For example, thearrangements described may not only be employed in communications suchas voice calls, but also in conference calls with more than two users,e.g. three-way calls, conference calls, and the like with multipleusers. The arrangements described may be implemented using peer-to-peernetworking, but in many cases will be implemented using a client/serverarchitecture.

The invention claimed is:
 1. A method performed by an application thatis operable on a first device that has capabilities for conductingcommunications over a network with a second device, comprising: usingthe application for collecting local data from sources associated withthe first device; in response to an occurrence of a communication overthe network between the first and second devices: identifying metadatathat has relevance to the communication, the metadata having differenttypes and further being derived from the collected local data; filteringthe identified metadata to eliminate metadata that does not meet one ormore predetermined freshness criteria, wherein the predeterminedfreshness criteria vary for different types of metadata; transmittingthe metadata meeting the predetermined freshness criteria to the seconddevice over the network for display on the second device, whereinmetadata transmissions are reduced for less-frequently-varying data; andresponsively to no metadata meeting the predetermined freshnesscriteria, transmitting, to the second device over the network fordisplay on the second device, default data having relevance to thecommunication, the default data being of one or more data types fromamong a plurality of data types, wherein each of the plurality of datatypes are respectively associated with different sources of local data.2. The method of claim 1, further comprising downloading the applicationby the first device.
 3. The method of claim 1, further comprisingcollecting local data and performing the transmitting of the identifiedmetadata upon initiation of the communication.
 4. The method of claim 1,wherein the identifying of metadata that has relevance to thecommunication includes identifying metadata pertaining to a low batterylife of the first device, data pertaining to an upcoming appointmentstored as calendar data within the first device, data about a proximityof the first device to the second device, data about whether the firstdevice is using an internal speaker, a speakerphone, or a wirelessheadset, contact data associated with a user of the first device, orcombinations thereof.
 5. The method of claim 1, wherein a service thatoperates using the network is configured to receive local data from thefirst or second devices.
 6. The method of claim 5, further comprisingtransmitting a file between the first and second devices using theservice.
 7. The method of claim 5, further comprising transmitting asubject string to the second device from the first device using theservice, wherein the subject is entered on a user interface of the firstdevice, and wherein the service facilitates display of the subject on auser interface of the second device.
 8. The method of claim 1, furthercomprising determining a freshness of metadata prior to transmittingmetadata from the first device to the second device for display usingthe service.
 9. The method of claim 1, wherein the communication overthe network between the first and second devices comprises a textmessage or an instant message.
 10. One or more computer-readable storagemedia storing instructions which, when executed by one or moreprocessors in a first device that is configured to participate in acommunication with a second device using a network on which a service isoperable, cause the first device to: operate a local data gatheringclient, the operating including collecting data from a plurality of datasources associated with the first device, each of the data sourceshaving a respective different data type, and identifying collected datafrom the data sources as being relevant to the communication bycomparing the collected data to one or more criteria, wherein the datacollected from the plurality of data sources have respective data types;transmit the identified data as first metadata to a service;responsively to the communication engagement between the first deviceand the second device, identify a portion of real-time data that isrelevant to the communication by comparing the real-time data to one ormore criteria, filter the identified real-time data to eliminate datathat does not meet one or more predetermined freshness criteria, whereinthe predetermined freshness criteria vary for different types ofmetadata, and transmit the real-time data meeting the freshness criteriaas second metadata to the service; and transmit default data relevant tothe communication, the default data collected from one or more defaultdata sources among the plurality of data sources responsively to datafrom the other data sources not identified as being relevant to thecommunication through operations of the local data gathering client,wherein, responsively to the participation in the communication at thefirst device, at least a portion of the first or second metadata or thedefault data is transmitted to the second device from the service fordisplay on a user interface of the second device.
 11. The one or morecomputer-readable storage media of claim 10, wherein the one or moredata sources include one or more of an accelerometer, GPS circuitry, adatabase for a calendar application, settings data, battery data, localWi-Fi or other geolocation data, phone application data, exerciseapplication data, data input by a user on a user interface, data from awearable device in communication with the first device, or combinationsthereof.
 12. The one or more computer-readable storage media of claim11, wherein the one or more data sources include data input by a user ona user interface, wherein the data input by a user constitutes subjectdata, wherein the subject data is entered using a voice-driven userinterface, and wherein at least a portion of the subject data isprovided to the second device from the service for display on the userinterface of the second device.
 13. The one or more computer-readablestorage media of claim 10, wherein the real-time data is received from asource selected from one of GPS circuitry, a database for a calendarapplication, battery data, or combinations thereof.
 14. The one or morecomputer-readable storage media of claim 10, wherein the service isconfigured to determine which of the first or second metadata areidentified as relevant to the communication and provided to the seconddevice for display.
 15. The one or more computer-readable storage mediaof claim 10, wherein the communication between the first and seconddevices comprises a text message or an instant message.
 16. A localdevice having telephony capabilities for engaging in a communicationwith a remote device, comprising: one or more processors; a userinterface for displaying communication information including metadataand for receiving selections by a user of the local device as inputs; anetwork interface for sending and receiving the communicationinformation; and one or more memory devices storing computer-executableinstructions which, when executed by the one or more processors, causesthe local device to: harvest data from one or more data sourcesavailable to the local device, the harvesting being performed in realtime for the communication, analyze whether the harvested data meets oneor more relevancy criteria, communicate data meeting the one or morerelevancy criteria to a remote service and receive data from the remoteservice over the network interface, in which the communication isperformed according to variability of the harvested data, configure theuser interface to enable a user to select data types, wherein datahaving the selected data types is transmitted by default to the remotedevice in response to the analysis identifying no data harvested by thelocal data gathering client that meets the one or more relevancycriteria, determine which data received from the remote service isrendered on the user interface, and render the data received from theremote service responsively to the determining.
 17. The device of claim16, wherein the one or more data sources include one of anaccelerometer, GPS circuitry, a database for a calendar application,settings data, battery data, local Wi-Fi or other geolocation data,phone application data, exercise application data, data input by a useron a user interface, data from a wearable device in communication withthe local device, or combinations thereof.
 18. The device of claim 17,wherein the remote service is configured to analyze data from at leasttwo data sources, and to transmit an icon or message for display on auser interface of the remote device based on the analysis.
 19. Thedevice of claim 16, wherein the remote service is configured todetermine an urgency parameter of the communication, and apply filteringcriteria based on the determined urgency parameter.
 20. The device ofclaim 16, wherein the communication over the network between the firstand second devices comprises a text message or an instant message.